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Abstract. - In equilibrium, the fluctuation-dissipation theorem (FDT) expresses the response 
of an observable to a small perturbation by a correlation function of this variable with another 
one that is conjugate to the perturbation with respect to energy. For a nonequilibrium steady 
state (NESS), the corresponding FDT is shown to involve in the correlation function a variable 
that is conjugate with respect to entropy. By splitting up entropy production into one of the 
system and one of the medium, it is shown that for systems with a genuine equilibrium state the 
FDT of the NESS differs from its equilibrium form by an additive term involving total entropy 
production. A related variant of the FDT not requiring explicit knowledge of the stationary state 
is particularly useful for coupled Langevin systems. The a priori surprising freedom apparently 
involved in different forms of the FDT in a NESS is clarified. 
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Introduction. — Stochastic thermodynamics pro- 
vides a framework for describing small driven systems 
embedded in a heat bath of still well-defined tempera- 
ture [1]. Its crucial ingredients are a formulation of the 
first law [2] and the notion of a stochastic entropy [3] 
both valid along single fluctuating trajectories. Using 
these concepts several exact relations for distribution func- 
tions for quantities like work [4, 5] and entropy produc- 
tion [3, 6-9] have been derived. Experimental tests have 
been performed on a variety of different systems. Promi- 
nent examples include colloidal particles manipulated by 
laser traps [10-12], biomolcculcs pulled by AFM's or op- 
tical tweezers [13, 14], and single defects observed using 
fluorescence techniques [15]. Reviews of this very active 
field can be found in Refs. [1, 16, 17]. 

A particularly interesting class of states are nonequilib- 
rium steady states (NESS) characterized both by a time- 
independent distribution and, as a result of the external 
driving, nonvanishing currents. If such a NESS is per- 
turbed by an additional small external force or field, one 
can ask whether the response of an observable of this 
system can be expressed by a correlation function in- 
volving this observable and a second one. For slightly 
perturbed equilibrium systems, such a connection be- 
tween response and equilibrium fluctuation is given by the 
well-known fluctuation-dissipation theorem (FDT) [18,19]. 
The appropriate correlation function involves the observ- 
able whose response is sought for and another variable that 



is conjugate to the perturbation with respect to energy. 
The first purpose of this letter is to show that previously 
derived somewhat formal looking FDTs for general Marko- 
vian processes [20, 21] acquire a particularly simple and 
transparent form using the concepts of stochastic thermo- 
dynamics: In a nonequilibrium steady state, the response 
of a system to an additional small perturbation is given 
by a correlation function of this observable and another 
one that is conjugate to the perturbation with respect to 
stochastic entropy. Moreover, by expressing entropy pro- 
duction in the system as the difference between total en- 
tropy production and that in the surrounding medium, we 
can show that for a large class of systems the FDT in a 
NESS can be obtained from the corresponding equilibrium 
form of the FDT by subtracting a term involving total en- 
tropy production. The latter result rationalizes and gen- 
eralizes recent results for diffusive systems driven by an 
external force [22,23] or shear flow [24], see Refs. [25,26] 
for first experimental tests of such extended FDTs. Adapt- 
ing a recently introduced alternative strategy for deriving 
an FDT [27], we discuss a variant not requiring explicit 
knowledge of the typically unknown stationary distribu- 
tion. This form will be particularly useful in simulations 
of coupled Langevin systems. Finally, we clarify the a pri- 
ori surprising apparent freedom involved in different forms 
of the FDT in a NESS. For a broader overview of the FDT 
especially in systems with glassy dynamics, we refer to the 
review [281. 
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Derivation of the FDT. — For a derivation of these 
results in a fairly general setting, we consider an arbitrary 
set of states {n}. These states could inter alia signify dis- 
crete spatial variables for a set of driven interacting diffu- 
sive degrees of freedom obtained by spatially discretizing 
Langevin equations. Likewise, they could code the states 
of any (bio)chemical reaction network. A transition from 
state m to n happens with a rate w mn (h), which depends 
on an external parameter h. The probability ip m {t) for 
finding the system in state m at time t obeys the master 
equation 

d t ^m{t) = ^2 L mni>n{t) (1) 



with generator 



J mni / ^rnk j 
k 



(2) 



where we suppress the /i-dependence. The stochastic 
trajectory n(t) is a sequence of jumps at times Tj from 
nj to rij. An observable A acquires a time-dependence 
through A(t) = Y, m A m^mn(t) along such a trajectory 
with mean (A(t)) = Yl m A m' l Pm(t)- A particularly rel- 
evant observable is the stochastic entropy [3] defined as 
s(t) = — In V'n(t) (t), where we set the Boltzmann con- 
stant to one throughout the paper. For any fixed h, 
we denote the stationary distribution by p n , which obeys 
LmnPn = 0. In such a NESS, the stochastic entropy 
becomes the observable 



s(t) = -lnp n(t) , 



Anp n 



(3) 



We are interested in the response of the system to a 
small perturbation h(t), where the system is initially pre- 
pared in the NESS corresponding to h — with station- 
ary distribution p^. The resulting general FDT has been 
discussed first by Agarwal more than 30 years ago [20]. 
For completeness and later reference, we briefly repeat its 
derivation. The generator is expanded in powers of h, 



L(i) = h° + h(t)L\ 



(4) 



where (L) mn = L mn . Due to the perturbation the distri- 
bution becomes time-dependent and is obtained through 
formally solving the master equation ([I]), 



E 



exp|y drL(r)l 



(5) 



The exponential function is to be understood as time- 
ordered. The mean response of an observable A is given 
through 



RA(t 2 ~h) 



(A(t 2 )B(h)), (6) 



h=0 



where we have introduced the generic form of the FDT 
equating the response with a correlation function involving 



a second observable B for which we will find different forms 
i?W labeled by different superscripts. 

Using the expansion of the generator Eq. Q, one im- 
mediately finds 



e L°( t2 - tl ) L l 



Introducing the observable 

= r £ i f D o / o \ 



(7) 



(8) 



we thus can relate the response function to the correlations 
of A with B in the unperturbed NESS, 



R A (t 2 -t 1 ) = (A(t 2 )B^(t 1 )). 



(9) 



The observable Eq. ([8]) can be cast in a more explicit form 
involving probabilities and rates by writing 

^mn IVnTn^nm ^mn ^ ^Vmk^rak (1^) 
k 

with the relative change of the rates 

a mn = d h lnw mn . (11) 
Hence, from Eq. ^ we obtain the 'Agarwal' form 

^rn} — / (.Pn /Prn ^j^nin^n m ^ ^Vmn^mn (12) 
n n 

of the observable appearing at the earlier time in the 
FDT ((9). 

Role of stochastic entropy. — To establish the con- 
nection between the generic FDT as expressed in Eq. ^ 
and the stochastic entropy, we consider two NESSs differ- 
ing by an infinitesimal time-independent h with distribu- 
tions p° and + hp\, respectively. Using Eq. Q and 
equating terms linear in h, the relation 



/ j m n fr'n / j in nr'n 



(13) 



holds. With the identification 

d h s m (h)\ h=0 = -p 1 Jp m (14) 
following from Eq. ([3]), we can express the response as 

R A (t2-h) = -J2 A m\^ 0{t2 - H) ] L° k y n (15) 
* — ' L J mk 



m kn 



d_ 
d_ 



3 L (t 2 -ti) 



(pilpDpl (16) 



(A(t 2 )[-d h s(h)}) = {A{t 2 )B^{h)) 



1th 



(17) 
(18) 
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where s(t) is to be understood as observable in the sense of 
Eq. {3}. Thus, the response is given by a correlation func- 
tion involving as second variable the one being conjugate 
to the perturbation with respect to stochastic entropy pro- 
duction. Formally similar relations have previously been 
derived for general stochastic processes [21] and also for 
the response of chaotic dynamics to changing initial con- 



ditions [29]. The FDT (17 1 contains as a special case an 
expression derived recently [30] following another route 
based on the Hatano-Sasa relation [31]. The advantage 
of the present discussion using the concepts of stochastic 
thermodynamics arises from the transparent physical iden- 
tification of the conjugate variable as stochastic entropy, 
which constitutes our first main result. 

As a consistency check, we consider the case where the 
steady state is a genuine equilibrium state for h = 0. In 
fact, two types of such systems should be distinguished. 
Class I systems exhibit even for any small constant non- 
zero h a genuine equilibrium state like any magnetic sys- 
tem in the presence of a perturbing magnetic field. For 
such systems, the stationary distribution is given by the 
Boltzmann-Gibbs distribution 



fifth) = exp{-[E n (h) ~ Hh)]/T], 



(19) 



where E n (h) is the internal energy, T the temperature 
of the heat bath, and T(h) = -Tin J2 n exp(~E n /T) the 
ft-dependent free energy of the system. The stochastic 
entropy obeys s n (h) = -lnp c n ^(h) = [E n (h) - T(h)]/T. 
Along a single trajectory, T(h) is constant and hence we 
have Tdhs(h)\h=o = dhE{h)\ h = . Inserted into (17 1, the 
FDT acquires its well-known equilibrium form 



TR A (t 2 - h) 



d_ 



(A(t 2 )[-d h E(h)] h=0 (h)) (20) 



involving the observable conjugate to h with respect to 
energy. 

Class II systems are in equilibrium at h — but driven 
into a NESS even at constant small h. The paradigmatic 
example is a perturbation through shear flow for which 
there is no corresponding E(h) for any h ^ 0. For such 



systems one still has the FDT in the form ( 17 1 but also in 
the Agarwal form with ([9|. 

Returning to the general case of perturbing an arbitrary 
NESS, the main advantage of the present formulation us- 
ing stochastic entropy becomes apparent when we split up 
the entropy production in the NESS into two terms [3] 



s(t) 



.£f(t- Tj )ln-^ 



w + - 

n-n ■ 

3 3 



(21) 



^5(t - Tj )ln 



p -w - + 



n + w + - 
rn- n n ■ 



= -Smed(*) + Stot(t)- 



The first term on the right hand side, s me d, denotes the 
entropy production rate in the medium which can in many 
cases be identified with the heat flow (divided by T) into 
the surrounding aqueous solution. The second term is 
the total entropy production rate. On average, the lat- 
ter is positive and integrated over a finite time obeys 
the detailed fluctuation theorem [3]. Pulling in the time- 
derivative in Eq. (17) and using Eq. pTj), the correlation 



part of the FDT becomes a difference between two terms 
involving entropy production, 

R A (h - h) = CA(*a)[Shamad](ti)) - (A(t 2 )[d h s to t}(ti)). 

(22) 

Note that, although the mean total entropy production is 
always non-negative, both terms can have either sign; see, 
e.g., Fig. 3a in Ref. [25]. 

We now show that for systems with a genuine equilib- 



rium state the first term in Eq. ( 22 1 corresponds to the 



equilibrium form of the FDT and hence the second term 
is an additive correction induced by the nonequilibrium 
conditions. Such an additive structure was found previ- 
ously [28,32] without, however, giving the correction term 
a transparent physical meaning. In the special case of 
a driven Langevin particle [23], the correction term has 
been identified as a correlation function involving the local 
mean velocity and has later been rationalized by observing 
the process in the locally comoving frame [33,34]. Gener- 
ally, the observable occurring in the first term in Eq. ( 22 1 
can be written 



dhs mc d(t) = y^ y 8(t- Tj)d h In - J ^ 3 
j 



w + 

3 3 



a n'n+ ~ a n+n 3 

3 3 3 J 



(23) 
(24) 



Since this observable appears in the correlation function 
at the earlier time t±, we have to average over all tra- 
jectories reaching state n(t), i.e., T j) a rrn + l— * 
J2kPkWkn(t)a k n(t) and similarly for the «„+„- term. Us- 
ing furthermore for an equilibrium system the detailed bal- 
ance relation p n w nm — p m Wmn, this pre-averaged expres- 



sion becomes Eq. (12 1. Hence, for any system in equilib- 



rium, the FDT (20 1 can also be written in the form 



R A {t 2 - h) = (A(t 2 )[d h s med ] h=0 (ti)). 



(25) 



If for the same system a NESS generated by a field h is 
additionally perturbed by the same field h, one can thus 
keep the equilibrium two-point observable (but now eval- 
uated under nonequilibrium conditions) and subtract the 
second term that involves the observable conjugate to to- 
tal entropy production. This recipe for deriving the FDT 
in a NESS constitutes our second main result. It sharpens 
and proofs the hypothesis formulated in [24]. 

Path weight approach. — The main virtue of the in- 
sight provided by the identifications of the various terms 
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entering the FDT as discussed above is of a conceptual 
nature. From a practical point of view, quite generally, 
the FDT allows to infer response functions from corre- 
lation functions, which arc obtained more easily both in 
experiments and in simulations. Necessary for a practi- 
cal implementation, however, is an explicit knowledge of 
the variable entering the correlation function in the FDT. 
Any of the variants discussed above requires knowledge of 
the stationary distribution p n , which, in general, is not 
known explicitly. A form of the FDT not requiring such 
knowledge can indeed be derived following a recent sugges- 
tion [27] exploited there with a different focus. In the fol- 
lowing we derive the explicit form of such an FDT both for 
general master equations and for coupled Langevin equa- 
tions. 

Consider the mean 



(A(t)) = j2mp[n(ty,h(t)] 

n(t) 

= Z^ A W 5TI77vi P 0l n (t)}, 



(26) 



n(t) 



P [n(t)] 



where P[n(t); h(t)] = exp{-S[n(t);h(t)]} is the 
path weight in the perturbed system, Pg[^(i)] = 
exp{— So[n(t)]} is the path weight in the unperturbed 
NESS, and the sum runs over all paths n(t). Taking the 
functional derivative of Eq. (26) with respect to h(ti) in 
order to calculate the response function ^ , the result can 
again be cast into the generic form 



R A (t2-t 1 ) = (A(t 2 )B^(t 1 )). 



The correlation function is measured in the unperturbed 
NESS and the conjugate observable is now expressed 
through 

6S[n(t);h(t)} 



B (p) (fi) 



Sh(h) 



(28) 



h=0 



Discrete state space. For a dynamics with rates which 
become time-dependent through an external perturbation, 
w mn (h(t)), the weight of a path starting at time to < t\ 
with some initial weight po = p n (o) and, after Nj jumps 
at Tj, ending at time t > t 2 is given by 



P[n(t); h(t)} = p exp 



dr r n(T ; 



n 

3=1 



W - + 

J 3 



where r n = 



(29) 



is the exit rate out of state 



Hence, Eq. (|28| becomes 



n . n. ' 

j j 



(30) 



Due to its second term, this observable is sensitive to the 
jumps. As its main advantage, it does not require knowl- 
edge of the p n in contrast to all forms discussed above. 
Since B^ appears in a correlation function at an earlier 



time, the average in Eq. (27) over the jump times and the 



states before the jumps can be performed as explained for 



Eq. (251 leading to the form (12 1, where the p n show up 



again explicitly. Whether in a simulation or an experi- 



ment one uses the conjugate variable in the form (12) or 



in the form (30 1 is a matter of convenience. The second 



form is particularly suitable if one knows the rates and 
their /i-dependence but not the stationary distribution. If 
one knows (or can measure) the latter more easily with- 



out knowing the rates explicitly, the form ( 1 7 1 may even 
be more appropriate. 

Langevin dynamics. The same approach can easily be 
followed for a set of N coupled degrees of freedom x = 
(xi, . . . ,Xff) obeying a Langevin dynamics 



Xa = HapFp + U a + Co 



with correlations 



(Ca(*l)C/j(*2)> = 2T l l a p5{t 2 - ii). 



(31) 



(32) 



Here, Fp{-x.,K) is the force acting on the (3 th particle 
and [i a p are mobilities connecting these degrees of free- 
dom. Advection by a fluid is included by a local velocity 
w Q (x, h). Here, and in the following we sum implicitly 
from 1 to N over all greek indices occurring twice. 
The path weight becomes 



P[x(t); h(t)] = Af exp jf * dt CaM^C/J 



(33) 



(27) 

with Ca replaced by the Langevin equation pll) , where Af 



is an irrelevant normalization. Following the same steps as 
in the discrete case, one finds for the conjugate observable^ 

= i(i Q - ij^Fp - u a )(d h F a + fi^jdhUy). (34) 

By using this variable in a simulation, one could thus pre- 
dict the response function for any perturbation by just 
calculating the corresponding correlation function which 
constitutes our third main result. 

Classification. — Different approaches allowed us to 
derive apparently different forms of the FDT in a NESS. 
However, as the response function depends only on the ob- 
servable A, all these different correlation functions must be 
the same. Hence, there is a class of equivalent observables 
{£>} leading to the same value of the correlation function. 
In particular, 

B (^ B (p)^ B («] ) (35) 

where = denotes the equivalence of these observables if 
they appear as observable at the earlier time in a two- 
time correlation function taken in the NESS. Moreover, 
in principle there are infinitely many variants of the FDT 



1 This result is independent of the chosen stochastic calculus (Ito 
or Stratonovich) as long as the mobility coefficients are independent 
of h and h is a spatially homogeneous perturbation. 
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Fig. 1: Example systems: a) Single driven colloidal particle 
and b) sheared colloidal suspension. 

since with B^ = B^ any normalized linear combination 
[c 1 B^+c 2 B^}/{c 1 +c 2 ), with C1.2 real, will be admissible. 

The three main variants for the second variable B ap- 
pearing in the FDT can more formally be classified as fol- 
lows: (i) The Agarwal form B^ ( |l2[ ) is distinguished by 
the fact that it involves only state variables and no time- 
derivative, i.e., no observables evaluated at jumps for the 
discrete case or no velocity obs ervables for Langevin sys- 
tems, (ii) The form B^ (14 1 is the unique one where 



the B observable is written as a time-derivative of such 
a state variable, which turns out to be the /i-derivative 
of the stochastic entropy, (iii) The observable B^ is the 
unique one not requiring explicit knowledge of the station- 
ary distribution. 

Examples. — We now illustrate both the general 
recipe for deriving an FDT for a NESS and the equivalence 
of the main three forms of such an FDT for two previ- 
ously studied cases of driven Langevin dynamics sketched 
in Fig. [TJ 

Driven colloidal particle. An overdamped colloidal 
particle with mobility /irj is driven by a force / along a pe- 
riodic potential V(x) and hence subject to the total force 
F(x) = —V'(x) + / [23]. The Langevin equation reads 



x{t) = p F{x) + ((t) 



(36) 



where the noise has zero mean and correlations 
(C(*i)C(*a)) = 2T/i (5(t2 — h). In the stationary state, 
the constant probability current can be written as 

j = (j, [F(x)p(x) - Td x p(x)] = v(x)p(x) (37) 

with the local mean velocity v(x). The three variants of 
the FDT can be derived as follows: 

(i) A perturbation of the driving force / corresponds to 
the operator L 1 = —^ad x , which implies with the contin- 
uum version of Eq. ^ and using Eq. ( 37 1 the Agarwal 
form 

TB {a) = v(x) - p, Q F{x) (38) 

distinguished by the fact that it does not involve any fluc- 
tuating velocity variable. 

(ii) The stochastic entropy production rate in the 
medium is given by [3,35] 



ed = (l/T)[-V'(x)+f]x. 



(39) 



Then T9/s mo d — x, which corresponds to the equilibrium 
form of the FDT since x is the conjugate variable of the 
force with respect to energy. In a former study [23], we 
found that the excess correlates A with the local mean 
velocity v{x) and hence 



v(x). 



(40) 



Since the total entropy production rate obeys s to t = 
xv{x) j '(pqT), we get the by no means obvious equivalence 



TdfStot = {x/no)dfv{x) = v(x) 



(41) 



when appearing in a correlation function at earlier times. 



(iii) Finally, specializing the observable (34 1 to this case, 
we get as conjugate observable 



ra (p) = l -{x-p F). 



(42) 



This third form, which does not require knowledge of the 
stationary distribution, can easily be expressed as a linear 
combination of the first two variants. 

Sheared suspension. For a second illustration, con- 
sider N colloidal particles with potential energy {/({r^}) 
composed of pairwise interactions immersed into a fluid 
which is sheared [24]. We neglect hydrodynamic interac- 
tions through fif-i = noSki- The velocity profile of the fluid 
is assumed to be u(r) = 7(y,0,0) T , where 7 is the strain 
rate and r = (x, y, z) T . Response relations in sheared sus- 
pensions have recently been studied also in the framework 
of mode-coupling theory [36]. In our formalism, the three 
main variants of the FDT specialize to the following ex- 
pressions: 

(i) The 'Agarwal' form when perturbing the system 
through a small variation of the strain rate reads 



d 



(43) 



where we have introduced the microscopic stress due to 
particle interactions 



Ilk 



dU 
dx k ' 



(44) 



The position of the fc-th particle is and the sum runs 
over all particles. The second term is 



d 1 
& *v = ^l2y k a~i U + Tln P] = y2vk(vk,x -72/fc), 



(45) 



where v k is the local mean velocity of the fc-th particle, 
(ii) The medium entropy production rate is [35] 



smcd = (1/T) J2ih - u(r fc )] • [-V*E7] 



and hence 



rpa ■ ^ dU 

± C 7 s mod = } y k - = <J X 

k k 



(46) 



(47) 
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becomes the microscopic stress. Comparing with the REFERENCES 



form (22 1 we can therefore deduce that T<9 7 Stot — &xy 



Here, the Agarwal form and the one based on entropy 
production become identical because <j xy depends only on 
{r^} and not on velocities. As noted earlier, a xy cannot be 
written as a conjugate observable with respect to energy 
since for any 7^0 the system reaches a genuine NESS 
instead of another equilibrium state. 

(iii) Following the path weight approach, we obtain by 
specializing Eq. (|34| 



(48) 



which can easily be used in simulations. 

A straightforward combination of the forms ( 43 ) 



and ( 48 1 leads to 



T [ 2jE ?(p) _ B «] = IV yk (± k - VKx ) (49) 

^ V 

as another admissible observable appearing in the FDT 
for a perturbation of the strain rate 7. This form stresses 
the relevance of deviations from the local mean velocity in 



analogy to the form (40 1 for the driven colloidal particle. 



Summary. — We have discussed the FDT for Markov 
processes driven into a NESS. The response of any observ- 
able to a perturbation can be expressed by a correlation 
function involving the observable conjugate to the per- 
turbation with respect to stochastic entropy production. 
By expressing the later through entropy production in the 
medium and the total one, the noncquilibrium form of the 
FDT can be written as the equilibrium one and an addi- 
tive correction. Alternatively, we have derived a variant of 
the FDT not requiring explicit knowledge of the station- 
ary distribution. A classification based on the concept of 
equivalent observables shows that, quite generally, there 
exist two linearly independent forms of the FDT from 
which one can derive three main variants distinguished 
by the nature of the conjugate observable. Our general 
framework not only rationalizes previous results obtained 
for case studies but should also be helpful in studying the 
FDT in specific future applications like, e.g., driven bio- 
chemical networks or active biophysical systems. 
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